Quick Sequential Organ Failure Assessment Score and the Modified Early Warning Score for Predicting Clinical Deterioration in General Ward Patients Regardless of Suspected Infection.

BACKGROUND: The quick sequential organ failure assessment (qSOFA) score is suggested to use for screening patients with a high risk of clinical deterioration in the general wards, which could simply be regarded as a general early warning score. However, comparison of unselected admissions to highlight the benefits of introducing qSOFA in hospitals already using Modified Early Warning Score (MEWS) remains unclear. We sought to compare qSOFA with MEWS for predicting clinical deterioration in general ward patients regardless of suspected infection. METHODS: The predictive performance of qSOFA and MEWS for in-hospital cardiac arrest (IHCA) or unexpected intensive care unit (ICU) transfer was compared with the areas under the receiver operating characteristic curve (AUC) analysis using the databases of vital signs collected from consecutive hospitalized adult patients over 12 months in five participating hospitals in Korea. RESULTS: Of 173,057 hospitalized patients included for analysis, 668 (0.39%) experienced the composite outcome. The discrimination for the composite outcome for MEWS (AUC, 0.777; 95% confidence interval [CI], 0.770-0.781) was higher than that for qSOFA (AUC, 0.684; 95% CI, 0.676-0.686; P < 0.001). In addition, MEWS was better for prediction of IHCA (AUC, 0.792; 95% CI, 0.781-0.795 vs. AUC, 0.640; 95% CI, 0.625-0.645; P < 0.001) and unexpected ICU transfer (AUC, 0.767; 95% CI, 0.760-0.773 vs. AUC, 0.716; 95% CI, 0.707-0.718; P < 0.001) than qSOFA. Using the MEWS at a cutoff of ≥ 5 would correctly reclassify 3.7% of patients from qSOFA score ≥ 2. Most patients met MEWS ≥ 5 criteria 13 hours before the composite outcome compared with 11 hours for qSOFA score ≥ 2. CONCLUSION: MEWS is more accurate that qSOFA score for predicting IHCA or unexpected ICU transfer in patients outside the ICU. Our study suggests that qSOFA should not replace MEWS for identifying patients in the general wards at risk of poor outcome.

Evaluating the Risk of Paroxysmal Atrial Fibrillation in Noncardioembolic Ischemic Stroke Using Artificial Intelligence-Enabled ECG Algorithm.

Background: The identification of latent atrial fibrillation (AF) in patients with ischemic stroke (IS) attributed to noncardioembolic etiology may have therapeutic implications. An artificial intelligence (AI) model identifying the electrocardiographic signature of AF present during normal sinus rhythm (NSR; AI-ECG-AF) can identify individuals with a high likelihood of paroxysmal AF (PAF) with NSR electrocardiogram (ECG). Objectives: Using AI-ECG-AF, we aimed to compare the PAF risk between noncardioembolic IS subgroups and general patients of a university hospital after controlling for confounders. Further, we sought to compare the risk of PAF among noncardioembolic IS subgroups. Methods: After training AI-ECG-AF with ECG data of university hospital patients, model inference outputs were obtained for the control group (i.e., general patient population) and NSRs of noncardioembolic IS patients. We conducted multiple linear regression (MLiR) and multiple logistic regression (MLoR) analyses with inference outputs (for MLiR) or their binary form (set at threshold = 0.5 for MLoR) used as dependent variables and patient subgroups and potential confounders (age and sex) set as independent variables. Results: The number of NSRs inferenced for the control group, cryptogenic, large artery atherosclerosis (LAA), and small artery occlusion (SAO) strokes were 133,340, 133, 276, and 290, respectively. The regression analyses indicated that patients with noncardioembolic IS had a higher PAF risk based on AI-ECG-AF relative to the control group, after controlling for confounders with the "cryptogenic" subgroup having the highest risk (odds ratio [OR] = 1.974, 95% confidence interval [CI]: 1.371-2.863) followed by the "LAA" (OR = 1.592, 95% CI: 1.238-2.056) and "SAO" subgroups (OR = 1.400, 95% CI: 1.101-1.782). Subsequent regression analyses failed to illustrate the differences in PAF risk based on AI-ECG-AF among noncardioembolic IS subgroups. Conclusion: Using AI-ECG-AF, we found that noncardioembolic IS patients had a higher PAF risk relative to the general patient population. The results from our study imply the need for more vigorous cardiac monitoring in noncardioembolic IS patients. AI-ECG-AF can be a cost-effective screening tool to identify high-risk noncardioembolic IS patients of PAF on-the-spot to be candidates for receiving additional prolonged cardiac monitoring. Our study highlights the potential of AI in clinical practice.

Development and validation of a deep-learning-based pediatric early warning system: A single-center study.

BACKGROUND: Early detection and prompt intervention for clinically deteriorating events are needed to improve clinical outcomes. There have been several attempts at this, including the introduction of rapid response teams (RRTs) with early warning scores. We developed a deep-learning-based pediatric early warning system (pDEWS) and validated its performance. METHODS: This single-center retrospective observational cohort study reviewed, 50,019 pediatric patients admitted to the general ward in a tertiary-care academic children's hospital from January 2012 to December 2018. They were split by admission date into a derivation and a validation cohort. We developed a pDEWS for the early prediction of cardiopulmonary arrest and unexpected ward-to-pediatric intensive care unit (PICU) transfer. Then, we validated this system by comparing modified pediatric early warning score (PEWS), random forest (RF); an ensemble model of multiple decision trees and logistic regression (LR); a statistical model that uses a logistic function. RESULTS: For predicting cardiopulmonary arrest, the pDEWS (area under the receiver operating characteristic curve (AUROC), 0.923) outperformed modified PEWS (AUROC, 0.769) and reduced the mean alarm count per day (MACPD) and number needed to examine (NNE) by 82.0% (from 46.7 to 8.4 MACPD) and 89.5% (from 0.303 to 0.807), respectively. Furthermore, for predicting unexpected ward-to-PICU transfer pDEWS also showed superior performance compared to existing methods. CONCLUSION: Our study showed that pDEWS was superior to the modified PEWS and prediction models using RF and LR. This study demonstrates that the integration of the pDEWS into RRTs could increase operational efficiency and improve clinical outcomes.

A multicentre validation study of the deep learning-based early warning score for predicting in-hospital cardiac arrest in patients admitted to general wards.

BACKGROUND: The recently developed deep learning (DL)-based early warning score (DEWS) has shown potential in predicting deteriorating patients. We aimed to validate DEWS in multiple centres and compare the prediction, alarming and timeliness performance with the modified early warning score (MEWS) to identify patients at risk for in-hospital cardiac arrest (IHCA). METHOD/RESEARCH DESIGN: This retrospective cohort study included adult patients admitted to the general wards of five hospitals during a 12-month period. The occurrence of IHCA within 24 h of vital sign observation was the outcome of interest. We assessed the discrimination using the area under the receiver operating characteristic curve (AUROC). RESULTS: The study population consists of 173,368 patients (224 IHCAs). The predictive performance of DEWS was superior to that of MEWS in both the internal (AUROC: 0.860 vs. 0.754, respectively) and external (AUROC: 0.905 vs. 0.785, respectively) validation cohorts. At the same specificity, DEWS had a higher sensitivity than MEWS, and at the same sensitivity, DEWS reduced the mean alarm count by nearly half of MEWS. Additionally, DEWS was able to predict more IHCA patients in the 24-0.5 h before the outcome, and DEWS was reasonably calibrated. CONCLUSION: Our study showed that DEWS was superior to MEWS in three key aspects (IHCA predictive, alarming, and timeliness performance). This study demonstrates the potential of DEWS as an effective, efficient screening tool in rapid response systems (RRSs) to identify high-risk patients.

Graph Convolutional Networks-Based Noisy Data Imputation in Electronic Health Record.

OBJECTIVES: A deep learning-based early warning system is proposed to predict sepsis prior to its onset. DESIGN: A novel algorithm was devised to detect sepsis 6 hours prior to its onset based on electronic medical records. SETTING: Retrospective cohorts from three separate hospitals are used in this study. Sepsis onset was defined based on Sepsis-3. Algorithms are evaluated based on the score function used in the Physionet Challenge 2019. PATIENTS: Over 60,000 ICU patients with 40 clinical variables (vital signs, laboratory results) for each hour of a patient's ICU stay were used. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The proposed algorithm predicted the onset of sepsis in the preceding n hours (where n = 4, 6, 8, or 12). Furthermore, the proposed method compared how many sepsis patients can be predicted in a short time with other methods. To interpret a given result in a clinical perspective, the relationship between input variables and the probability of the proposed method were presented. The proposed method achieved superior results (area under the receiver operating characteristic curve, area under the precision-recall curve, and score) and predicted more sepsis patients in advance. In official phase, the proposed method showed the utility score of -0.101, area under the receiver operating characteristic curve 0.782, area under the precision-recall curve 0.041, accuracy 0.786, and F-measure 0.046. CONCLUSIONS: Using Physionet Challenge 2019, the proposed method can accurately and early predict the onset of sepsis. The proposed method can be a practical early warning system in the environment of real hospitals.

Detecting Patient Deterioration Using Artificial Intelligence in a Rapid Response System.

OBJECTIVES: As the performance of a conventional track and trigger system in a rapid response system has been unsatisfactory, we developed and implemented an artificial intelligence for predicting in-hospital cardiac arrest, denoted the deep learning-based early warning system. The purpose of this study was to compare the performance of an artificial intelligence-based early warning system with that of conventional methods in a real hospital situation. DESIGN: Retrospective cohort study. SETTING: This study was conducted at a hospital in which deep learning-based early warning system was implemented. PATIENTS: We reviewed the records of adult patients who were admitted to the general ward of our hospital from April 2018 to March 2019. INTERVENTIONS: The study population included 8,039 adult patients. A total 83 events of deterioration occurred during the study period. The outcome was events of deterioration, defined as cardiac arrest and unexpected ICU admission. We defined a true alarm as an alarm occurring within 0.5-24 hours before a deteriorating event. MEASUREMENTS AND MAIN RESULTS: We used the area under the receiver operating characteristic curve, area under the precision-recall curve, number needed to examine, and mean alarm count per day as comparative measures. The deep learning-based early warning system (area under the receiver operating characteristic curve, 0.865; area under the precision-recall curve, 0.066) outperformed the modified early warning score (area under the receiver operating characteristic curve, 0.682; area under the precision-recall curve, 0.010) and reduced the number needed to examine and mean alarm count per day by 69.2% and 59.6%, respectively. At the same specificity, deep learning-based early warning system had up to 257% higher sensitivity than conventional methods. CONCLUSIONS: The developed artificial intelligence based on deep-learning, deep learning-based early warning system, accurately predicted deterioration of patients in a general ward and outperformed conventional methods. This study showed the potential and effectiveness of artificial intelligence in an rapid response system, which can be applied together with electronic health records. This will be a useful method to identify patients with deterioration and help with precise decision-making in daily practice.

Artificial intelligence algorithm to predict the need for critical care in prehospital emergency medical services.

BACKGROUND: In emergency medical services (EMSs), accurately predicting the severity of a patient's medical condition is important for the early identification of those who are vulnerable and at high-risk. In this study, we developed and validated an artificial intelligence (AI) algorithm based on deep learning to predict the need for critical care during EMS. METHODS: We conducted a retrospective observation cohort study. The algorithm was established using development data from the Korean national emergency department information system, which were collected during visits in real time from 151 emergency departments (EDs). We validated the algorithm using EMS run sheets from two EDs. The study subjects comprised adult patients who visited EDs. The endpoint was critical care, and we used age, sex, chief complaint, symptom onset to arrival time, trauma, and initial vital signs as the predicted variables. RESULTS: The number of patients in the development data was 8,981,181, and the validation data comprised 2604 EMS run sheets from two hospitals. The area under the receiver operating characteristic curve of the algorithm to predict the critical care was 0.867 (95% confidence interval, [0.864-0.871]). This result outperformed the Emergency Severity Index (0.839 [0.831-0.846]), Korean Triage and Acuity System (0.824 [0.815-0.832]), National Early Warning Score (0.741 [0.734-0.748]), and Modified Early Warning Score (0.696 [0.691-0.699]). CONCLUSIONS: The AI algorithm accurately predicted the need for the critical care of patients using information during EMS and outperformed the conventional triage tools and early warning scores.

Subject-Independent Brain-Computer Interfaces Based on Deep Convolutional Neural Networks.

For a brain-computer interface (BCI) system, a calibration procedure is required for each individual user before he/she can use the BCI. This procedure requires approximately 20-30 min to collect enough data to build a reliable decoder. It is, therefore, an interesting topic to build a calibration-free, or subject-independent, BCI. In this article, we construct a large motor imagery (MI)-based electroencephalography (EEG) database and propose a subject-independent framework based on deep convolutional neural networks (CNNs). The database is composed of 54 subjects performing the left- and right-hand MI on two different days, resulting in 21 600 trials for the MI task. In our framework, we formulated the discriminative feature representation as a combination of the spectral-spatial input embedding the diversity of the EEG signals, as well as a feature representation learned from the CNN through a fusion technique that integrates a variety of discriminative brain signal patterns. To generate spectral-spatial inputs, we first consider the discriminative frequency bands in an information-theoretic observation model that measures the power of the features in two classes. From discriminative frequency bands, spectral-spatial inputs that include the unique characteristics of brain signal patterns are generated and then transformed into a covariance matrix as the input to the CNN. In the process of feature representations, spectral-spatial inputs are individually trained through the CNN and then combined by a concatenation fusion technique. In this article, we demonstrate that the classification accuracy of our subject-independent (or calibration-free) model outperforms that of subject-dependent models using various methods [common spatial pattern (CSP), common spatiospectral pattern (CSSP), filter bank CSP (FBCSP), and Bayesian spatio-spectral filter optimization (BSSFO)].

EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy.

BACKGROUND: Electroencephalography (EEG)-based brain-computer interface (BCI) systems are mainly divided into three major paradigms: motor imagery (MI), event-related potential (ERP), and steady-state visually evoked potential (SSVEP). Here, we present a BCI dataset that includes the three major BCI paradigms with a large number of subjects over multiple sessions. In addition, information about the psychological and physiological conditions of BCI users was obtained using a questionnaire, and task-unrelated parameters such as resting state, artifacts, and electromyography of both arms were also recorded. We evaluated the decoding accuracies for the individual paradigms and determined performance variations across both subjects and sessions. Furthermore, we looked for more general, severe cases of BCI illiteracy than have been previously reported in the literature. RESULTS: Average decoding accuracies across all subjects and sessions were 71.1% (± 0.15), 96.7% (± 0.05), and 95.1% (± 0.09), and rates of BCI illiteracy were 53.7%, 11.1%, and 10.2% for MI, ERP, and SSVEP, respectively. Compared to the ERP and SSVEP paradigms, the MI paradigm exhibited large performance variations between both subjects and sessions. Furthermore, we found that 27.8% (15 out of 54) of users were universally BCI literate, i.e., they were able to proficiently perform all three paradigms. Interestingly, we found no universally illiterate BCI user, i.e., all participants were able to control at least one type of BCI system. CONCLUSIONS: Our EEG dataset can be utilized for a wide range of BCI-related research questions. All methods for the data analysis in this study are supported with fully open-source scripts that can aid in every step of BCI technology. Furthermore, our results support previous but disjointed findings on the phenomenon of BCI illiteracy.